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Tbis  project  addressed  three  fundamental  areas  in  statistical  learning  theory  and  algo¬ 
rithms: 

1.  a  practical  and  theoretically  sound  method  for  estimating  generalisation  performance 
of  nonlinear  learning  systems  (Generalized  Prediction  Error  {GPE)), 

2.  a  more  powerful  and  efficient  class  of  network  architectures  (Parametrized  Projection 

Pursuit  Regression  Networks),  and 

3.  faster  real-time  learning  methods  based  on  asymptotically  optimal  stochastic  gradient 
search- 

Under  the  sponsorship  of  this  grant,  my  research  group  published  the  following  papers: 

“The  Effective  Number  of  Parameters;  an  Analysis  of  Generalization  and  Regularization 
in  Nonlinear  Learning  Systems*’,  John  Moody,  in  Advances  in  Neural  Information 
Processing  Systems  4,  Moody,  Hanson,  and  Lippmann,  eds.,  Morgan  Kaufmann.  Palo 
Alto,  (1992). 

“Towards  Fhster  Stochastic  Gradient  Search"  Christiam  Darken  and  John  Moody,  in  Ad¬ 
vances  in  Neural  Information  Processing  Systems  4,  Moody,  Hanson,  and  Lippmann, 
eds.,  Morgan  Kaufinann,  Palo  Alto,  (1992). 

“Networks  with  Learned  Unit  Response  Functions"  John  Moody  and  Norman  Ysrvin,  in 
Advances  in  Neural  Information  Processing  Systems  4,  Moody,  Hanson,  and  Lipp¬ 
mann,  eds.,  Morgan  Kaufmann.  Palo  Alto,  (1992). 

Additionally,  Christian  Darken  finished  his  Ph  D.  research  on  topic  (3).  He  presented 
.  his  thesis  work  at  the  Neural  Networks  and  Signal  Processing  Conference  in  Copenhagen 
in  September  1992  (right  after  the  keynote  speech  by  the  renowned  Lexinart  Ljung)  and 
successfully  defended  his  Ph.D.dissertation  at  Yale  in  October  1992. 
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